SEEING AND HEARING SPEECH 

lessons in lipreading and listening 

PI/TOP 



User Guide 



SENSIMETRICS 



Our warranty . . . 

Thank you for purchasing Seeing and 



Please fill out rhe owner identification card Thar is enclosed and send it to us. 
This card authorizes you ro obtain technical support and allows us To send 
you software upgrades- 
One year of free Technical support for Seeing and Hearing Speech is provided 
from rhe date of purchase. Contact information for Technical support is 
given in Appendix C. Please he sure to include your product's Serial Number 
w hen contacting us. 



If the Seeing and Hearing Speech software that you have purchased docs not 
work as described in this User Guide, and your problem cannot be resolved, 
we will cither provide upgraded software or authorize you to rciurn the 
product for a refund. 

Copyright 

You must respect copyright law: Carefully read the license agreement for this 
software. It is important that you understand your rights in its use, as well as 
the restrictions on its distribution or sale to others. By installing the software 
you agree that you will not copy it, that you will not give or sell a copy to 
anyone, and that you will not incorporate any of it into other work. 



{'.■{might C SttuinKtnct ( jtrp uatxHi and it* Ijcciwki QunLTimt jnd me QuickTime bqpi are 
uukmuk* utetlunder Ijcciue- The QuarkTme kign i* rrgi&icfed in the LIS. and ochef ftxjnmcw The retab 
clkk 1M nlm U eopiiighi c 1^31)1 Birpc iX CthiL and Robert lUneUm. Vlttbuv nicrademui of 
Mvnrtairt CorpnriCKHV \\ hciwcf c jfunfcoJ, VfaAn* n?l*f* Ut MJcroutlVt t^»iiri£M%icrn* 



Contents 



in 



Chapter 1 

introduction Introduction 5 

Chapter 2 

overview Organization 9 

Navigation 9 

Lesson Structure 10 

Practice and Test Modes 10 

Speech Presentation Conditions 11 

Chapter 3 

Getting Started Navigating to a Lesson 13 

Selecting Practiceor Test Mode 19 

Using Practice Mode 19 

Selecting Presentation Conditions 21 

Using Test Mode 24 

Types ot Lessons 30 

Chapter 4 

Training Guidelines Order of Lessons 31 

Using Test and Practice Modes 31 

Adjusting Presentation Conditions 32 

Suggestions 33 

Chapter 5 

viewing Results The Results Screen 37 

The Plot Screen 39 



Chapter 6 

Basic* of Speech Letters vs Sounds 41 

OMnnutnkation Speech Sounds and Lip Shapes 43 

Stress, Intonation, and Length 45 

Use of Context 46 

Practical Communication Tips 47 

Appendix A 

List of Lessons Vowels 49 

Consonants 50 

Stress, Intonation, and Length 51 

Everyday Communication 51 

Appendix B 

Installation and Setup Software Installation 53 

Audio Setup 55 

Video Setup 56 

Appendix C 

Troubleshooting and Possible Problems and Their Remedies ... 59 
Technical Support Technical Support 60 

Index Index 61 



SEEING AND HEARING SPEECH 

User Guide 



Chapter 1: Introduction 



Welcome fo Seeing and Hearing Speech* a training program in 
auditory- visual communication for people with hearing loss. 'ITiis 
program has been designed to provide practice in putting together 
the visual (what wc sec) and auditory (what we hear) signals and using this 
combined information to improve speech understanding 

Many people with hearing loss remark that "I hear best when I Vc got my 
glasses on! 1 * and find it difficult to understand why this is so. 'iTic reason 
is not really all thar complex. As a general rule, those speech sounds that 
are hard to hear are produced with mouth and Up shapes that are usually 
quite easy to sec, and those speech sounds that arc hard to sec are usually 
fairly easy to hear. 'Ilic visual and auditory signals complement one another 
losing them together by both looking and listening helps make understanding 
speech much easier than it is by looking or listening alone. 

Practice with Seeing and Hearing Speech should provide you with two kinds 
of benefits: 1) direct improvements in communication effectiveness; and 2) 
reduced anxiety in difficult listening situations. Both of these bcnelitscan 
be achieved through repeated practice with the lessons presented in the 
program and through an understanding of the nature of auditory-visual 
commu ni ca (ion. 

YCith respect to communication effectiveness, the primary goal of Seeing 
and Hearing Speech is to have you learn the associations between the heard 
and seen cues for the elements of speech - the vowels and the consonants, 
learning those associations will come, with practice, for almost everybody. 
With that skill your ability to understand words and short phrases will 
be enhanced. You should sec improvements over time in your test scores 
as well as in your understanding of brief isolated utterances in everyday 
conversation. 
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A more difficult task, which unfortunately is learned more slowly, is remem- 
bering and interpreting a long sequence of cues, such as occurs in sentences. 
If you have ever tried to learn a foreign language you may appreciate how 
much easier short phrases and words are to understand than long passages. 
Using lip reading as a supplement to hearing is similar. Tor most people, 
this limitation on the ability to remember and process the visual elements 
in longer utterances will be a major hurdle that will take a long time to 
overcome. 



I*ase of speech communication can also be enhanced through the use of 
stress and intonation cues, racial gestures, and context, all of which are 
presented in Seeing and Hearing Speech. Many of these types of cues, such 
as rising voice pitch and raised eyebrows, arc W'cll know r n from everyday 
experience. However, it is beneficial to have a heightened awareness of them, 
and to know* that different people make those cues differently and to varying 
degrees. It is likewise good to be keenly aware of the communication context 
so that you can make use of expectations about what might be said. 'iTic 
use of context is also important for piecing together a complete phrase or 
sentence from knowledge of some of the parts. Training in all of these 
areas, w hich go beyond the spoken sequence of vowels and consonants, will 
improve your communication ability. 

Anxiety in communication situations is one of the main problems experi- 
enced by people with hearing impairment, and it is hoped that practice with 
Seeing and Hearing Speech will help to reduce it. You will deal with difficult 
communication settings more easily not only because you can combine the 
visual and auditory cues more effectively, but also because you will have a 
better understanding of auditory-visual communication and your own abili- 
ties. Knowing that there are real limitations in lipreading cues helps one 
accept that some communication situations will be just too difficult. The 
stress-free practice you have with Seeing and Hearing Speech will help 
you appreciate the limitations in lipreading alone, and the need to bring 
together all available cues - auditory; visual, and contextual - for better speech 
understanding 
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The following chapter {Chapter 2, "Overview") presents a brief summary of 
Seeing and Hearing Speech and its primary features. Chapter 3 will take you 
stcp-bv-stcp through one lesson as a detailed example of how all the lessons 
in the program arc used. It will give complete descriptions of the controls, 
options and features that Seeing and Hearing Speech makes available to 
you. Guidelines for how the lessons should be used by people with various 
degrees of hearing loss arc given in Chapter 4. The storage and display of test 
results are explained in Chapter 5* Chapter ft provides helpful background on 
auditory- visual speech communication* 

This User Guide is available as an Adobe Acrobat .pdf document on the 
product CD-ROM- You must first install Adobe Acrobat Reader before view- 
ing the .pdf version of the guide. The Acrobat Reader installer is included 
on the CD-ROM in a folder labeled Acrobat Reader Once Acrobat Reader is 
installed you may double-click on the file "Uscr*s Guidc.pdf" to view or print 
the document. This .pdf document can be viewed in full color on the screen. 
It will also come in handy if you misplace the printed User Guide 
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Chapter 2: Overview 



This chapter of the User Guide presents an overview of Seeing and 
Hearing Speech. It briefly describes how the lessons arc organized, 
how to navigate your way through the program, and how a typical 
lesson works. More detailed descriptions of these topics will be presented in 
subsequent chapters. Tor help with the installation of the program on your 
computer, sec "Appendix B: Installation and Setup/ 1 

Organization 

Seeing and Heating Speech is a collection of lessons designed for training in 
the use of visual and auditory- cues for understanding speech, 'lite lessons 
are organized into four broad groups devoted to different aspects of speech 
and the speech -reception task: 1) Vowels, 2) Consonants, 3) Stress, Intona- 
tion, and Ixngrh, and 4) Everyday Communication. Within each of these 
four groups there arc subgroups of lessons that focus on specific aspects 
of the group. Por example, one subgroup of lessons within the Consonants 
group covers the consonants "p 11 , *V\ and "m*\ Lessons within a subgroup 
typically differ in the nature of the speech materia) used. Some lessons use 
isolated words, some use a short phrase, and others use sentences. All of the 
lessons in Seeing and Hearing Speech are listed in Appendix A. 

Navigation 

Starting the Seeing and Hearing Speech program presents you with a box for 
name entry, and then the Startup screen* By clicking the Contents button on 
the Startup screen, you will be given a choice among the four lesson groups 
After choosing a group, you will then be given the menu of subgroups. 
Finally, after choosing a subgroup, you will select a specific lesson. At each 
level in this hierarchy explanatory text is presented to help you understand 
the content and goals at that level. You can always go back up to a higher 
level in the hierarchy by clicking the Back button. 
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A detailed example of how you get to a specific lesson is given in Chapter 
\ "Getting Started." 



Lesson Structure 

A typical lesson screen is shown below, livery lesson has buttons on the left 
side of the screen on which a word, phrase, or sentence is printed. 



Rounded-Lip Vowols 1 




is c=: 



On the right side of the screen is the video window, where the video footage 
of a person speaking is presented. liach button on the left is paired with 
a speeeh utterance* For example, in a lesson that uses isolated words, the 
button labeled "book" would be paired with an audio/video recording of 
the talker speaking the word "book"- Lessons that use sentences, however, 
sometimes use a shortened label on the button that pairs it to a sentence. 
For example, the button lain- led "book" might be paired with the sentence 
"She wrote it in her book." 



Practice and Test Modes 

livery lesson in Seeing and Hearing Speech can be used in either of two 
modes * practice or test. The choice of mode is made prior to entering 
the lesson. 
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In practice mode you select die hem to be presented by clicking one of the 
labeled buttons. Practice mode allows you to observe each of the speech 
utterances in a lesson at will* with the ability to adjust speech presentation 
conditions interactively (sec below). 

In test mode the program selects the item to be presented, after which you 
have to click the button you think is paired with that item. By so doing, the 
program tests your ability to identify the spoken items in the lesson under 
conditions that are fixed in advance. No adjustments to speech presentation 
conditions (see below) arc allowed in test mode. These conditions arc selected 
prior to tlie start of a lesson. Your test results will be saved so lhat you can 
track your progress over time (sec Chapter 5, "Viewing Results"). 

Speech Presentation Conditions 

Seeing and Hearing Speech lets you choose among three different speech 
presentation conditions: 

Auditory-Visual, in which both the sound and video are presented; 
Auditory Only, in which only sound is presented; and 
Visual Only* in which only video is presented. 

These choices are made using the two buttons in the middle of the bottom 
of the screen. Clicking the button with the video screen icon turns the video 
on and off; clicking the button with the loudspeaker icon turns the audio 
on and off. 

Depending on the similarity of the speech utterances used, some lessons will 
be very difticult using Auditory Only reception or Visual Only reception. In 
addition, some users with severe hearing loss may rind some lessons difficult 
with Audi tor\'- Visual presentation. To guide you in your choice* every lesson 
contains indicators of the appropriateness of the lesson for each of the three 
presentation conditions. 



In addition to the three combinations of auditory and visual speech prcscnta- 
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tion, the quality of the auditory* cues that you receive can be controlled in 
either of two ways: 

Volume Level. By adjusting the volume control on your loudspeakers* you 
can reduce the volume to such a low* level that you will be forced to attend 
more carefully to liprcading in order to pick up the information necessary 
for speech understanding. 

Background Noise. By clicking the Noise button you arc given control 
of noise that degrades the audio recording and makes the speech-reception 
task harder The type of noise and the volume level you choose will be 
determined both by your speech reception skills and by the complexity of the 
materials being practiced. 

In order to help you see the lip and mouth formations that signal various 
speech sounds. Seeing and Hearing Speech allows }x>u to slow dow r n the 
talker. (Imagine how useful this would be in everyday life!). By clicking the 
Slowmotion button* the video (only) of the previous item will be repeated 
at half speed. 

TH$ overview has presented only briefly the main features of Seeing and 
Hearing Speech. All of the topics discussed so far* as well as background and 
training guidelines, will be explained in detail in the following chapters. 
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T 



his section of the manual rakes you srep-by-srep 10 a specific lesson 
and shews you the ways in which the lesson can he used. 



Navigating to a Lesson 

This section of the guide will explain the steps required to reach a particular 
le^nn, starring frcim the beginning. After the program has been installed 
(see Appendix H there ■ . I l>e an icon on your desktop labeled "Seeing and 
Heating Speech." Double click on the icon to start the program. 

The Startup Screen 

When you st^rt Seeing and I tearing Speech, this is the first screen mu will 
sec. 
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CHAPTER 3 
Getting Started 



The first step is fo enter your name. Your first name is sufficient. It is possible 
to enter the program without entering a name, hut this could cause problems 
later. If someone else also uses the program without a name, your results and 
theirs will be mixed together. Therefore, it is best to enter a name. 

When the program encounters a name that has not been used before, it will 
ask if that user's name should be added. Click Add l. ser and the namc-cntrv 
window will disappear. Your name is now registered in the program. Use that 
same name to enter the program in the future. 



*fhc five buttons on the Startup screen arc used cither to move around the 
program or to provide you with information or assistance. *l*hcy perform 
the following functions: 

Contents This takes you to the table of contents for Seeing and Hearing 
Speech. Click this and you will be able to select one of the four lesson 
groups. 

Results As you work your way through Seeing and Hearing Speech a 
running record is kept of your test results. Over time )*>u will want to look 
at these score* to check on your progress. Clicking this button provides you 
with access to your scores. 

Help Click this and you will obtain information about each of the buttons 
on the screen. W hen you have finished reading the information, click OK 
to return to the main screen. 

Tips This button provides you with advice about how to use Seeing and 
Hearing Speech. When you have finished reading the information, click OK 
to return to the main screen. 

Exit Click this button when you want to exit the program. On Macintosh 
computers, this button is labeled Quit. 

The next step is to move into the program. Click Contents to go to the 
Contents screen. 
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The Contents Screen 

This screen show* the four major lesson groups in Seeing and Hearing 
Speech. 

Mfl* Contents 



***** 




Lessons in the Vowels and Consonant* groups provide practice in the rec- 
ognition and discrimination of these two major types of speech sounds, 
emphasizing both the sounds and the bp shape* that distinguish them. Les- 
sons in Stress Inronanon, and length cu e you practice with factors .such 
as pitch, intensity, and duration cues, which are not xssooatcd with specific 
vowel or consonant sounds. Ixssons tn Kvcryday Communicanon are huilr 
around various real-life contexts and situations. They are intended to help you 
exercise the knowledge you gained from the other lessons; they also give you 
practice in using your knowledge of what mt^tf/ft said in a given context to 
help you understand what ts said. 
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You can select any of the four lesson groups by clicking the label For this 
tutorial, however, click Vewcls. This will bring up the lexi screen shown 
here, which provides you with some useful information about die vowels 
of American Knglish, and which you should read before you go on to the 
next screen. 



I '^'Vowels 
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At the bottom of die screen you can sec four button*. The Help burton 
can be used to get informant -n about the burtons on the screen, while Tips 
will answer questions you might have about the use of Seeing and Hearing 
Speech. ( )n the right hand side of the screen are the other two buttons, 
marked Back and Next. 'ITiesc navigation bunom are used to move you 
backwards and forwards, respectively, through Seeing and Hearing Speech. 

In order to reduce the need to manipulate the mouse^ two keyboard keys 
have been made to have the same effect as clicking die Back or Next buttons. 
The Tisc* Lev (usually in the upper left part of the keyboard) is equivalent 
to clicking Back, and the 'Knrcr' key is the same as clicking Next. These 
keyboard shortcuts work throughout the program, wherever Back or New 
appear on the screen. 



Once youVe finished reading the information on the screen, dick Next (or 
press hnter) and you will go to the next screen. [If you click Back (or press 

Ksc) instead of Next you will return to the Contents screen). 
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The Subgroup Selection Screen 

The ncxr screen mu cncounrcr, shown here, j»jvc<* ihc six lesson subgroups 
within the VowcIm group. 



mi Vowels 












■■■umiupVM'Hi 












1 1 




- II * 1 



Click the first subgroup, RnundexMjp Vowels, and you'll see the follou/ini» 
screen, which provides infnrmabon on this set of vowels. 



Rounded-Lip Vowels 
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( )ncc you'v e read this, click Next DO move to ihc next screen* 
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The Lesson Selection Screen 

I his screen lists the six lessons available in the Roundcd-IJp VViucIs lesson 
group. The contents of these lessons can be seen by referring to the bar of 
lessons in Appendix A. 



[Dj Rounded-Lip Vowels 
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Click Rounded- Up Vowels I and vou'll move io the screen shown here. 



tflj Rounded Lip Vowols 1 
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l his screen provides you with information on the lesson that f* illows and 
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also makes recommendations about the three possible presentation condi- 
tions. Tor this particular lesson it is recommended (by a green circle) that 
you use either Auditory-Visual or Auditor)' Only presentation at first* and try 
Visual Only presentation after some practice (indicated by a yellow circle). 

The user name currently in effect is shown here to let you check that it is 
correct. 'lest results gathered with this lesson will be stored under that user 
name. 1 f the user name is not correct* you can change it by holding down 
the Ctrl key (Command key for Macintosh computers) on your keyboard 
while also typing the letter **p*\ 'lliis will bring up the name-entry window 
so that you can enter another name. *lTiis Otrl-P (Command-P on Macintosh 
computers) (unction is made available almost everywhere in the program as a 
way of checking and changing the current user name. 

Selecting Practice or Test Mode 

'lb proceed to the lesson you must first decide how it will be conducted - in 
practice mode or in test mode. 

In practice mode, you control which item is presented. In addition, you can 
change the presentation condition and the background noise while the speech 
items arc presented. 

In test mode, the program selects the items to be presented. Also, you decide 
on the presentation condition and noise setting prior to the start of the 
lesson. In test mode, these selections cannot be changed after the lesson 
begins. 

Ixt*s try practice mode first. Click Practice and you'll sec the lesson screen 
shown here. 

Using Practice Mode 

'Inhere arc quite a few buttons on this screen, some of which you will 
recognize and others that are new. Don't be intimidated by this layout - it*s 
really not very difficult. 
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Let's mart by clicking the button labeled "boot". Vou should see and hear (if 
juur hearing is good enough) a talker say that word. If you am the word 
presented again just click Repeat at the bottom of the screen. If you want to 
slow down the video ro get a betrer Took ar the talker's lip movements, simply 
click SJowmoiion and you'll see the wxrrd "boot 1 * repeated in slow -motion. 
There is no sound with the slow-motion playback because it would sound 
very strange and wouldn't help you at all. 



j fTJ Rounded-Lip Voimlft 1 




is c=: 



If you feci comfortable with the buttons so far, let's have a look at some 
of the other options. The Tips and Help buttons were explained with the 
Startup screen. Clicking Tips provides advice on a list of topics that is the 
same throughout the program. So if you click Tips here you will see the same 
list of rips that you saw when you clicked it in the Startup screen. Clicking 
Help will give you an explanation of the choices you have at the specific point 
where you arc in the program. It explains what each button available to you at 
the time will dfx The information Help provides, therefore, will be different 
at different points in the program because die choices will be different. 
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Selecting Presentation Conditions 

Centered at the bottom of the screen you con see two buttons. One 
is a graphic icon of a person on a video screen and the other shows a 
loudspeaker. Click the video button and a ted line will appear across it. "I His 
indicates that the video is turned off and that when a word button is clicked 
rhete will he no video. This is how you select the Auditory -Only presentation 
condition. If you click the video button again, the red line will disappear and 
the video will again be presented. 

I he loudspeaker button work* in a similar manner to turn the speech audio 
on and off. To select Visual Only presentation, turn the audio off and leave 
the video on, 

Nov you are familiar with the functions of these two buttons. 



Turns the video on and off 



Turns the speech audio on and oil 



Adding Noise 

The next button to look at is labeled Noise. Click Noise and this window 
will appear. 



These controls allow you io add background noise to the speech sound that 
vou hear in the lesson* 



Noise 



Note. \bu can also have noise playing white the speed} audio is turned oft, 
though there is no point in doing so. 
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Selecting the type of noise 

You have a choice of three actual noises * parry noise, machine noise, and 
street noise - as well as rwo types of music- jazz and calypso. Music is 
considered to be "noise*' here because it can also interfere with speech 
understanding You can select any one of the noise types by clicking the circle 
to the left of your choice. 

Setting the noise level 

To turn on the noise, click in the gray rectangle next to the Noise scale at the 
left of the Noise w indow; The noise will start at the volume level at which 
you clicked. If the noise is too loud, reduce it by moving the cursor lower 
down on the noise scale (around -2 or -3) and clicking again. If you want the 
noise louder, click on a higher point on the noise scale, just move the arrow 
up as high as you want and then click. To turn off the noise, move the arrow 
to the bottom of the gray area marked "off " and click. 

Note: You witt hear a brief gap in the noise every so often. This gap ts supposed to 
be there and does not indicate a problem. 

Once you have selected the appropriate noise type and noise level, return to 
the lesson screen by clicking the OK button. 

Controlling Volume 

At times you may want to make the speech audio less informative by making 
it weaker rather than by adding noise. The volume level of the sound from 
your loudspeakers can be controlled in one of nvo ways. *lTic first, and 
simplest if available, is the volume control knob that is on most of the 
loudspeakers that come with personal computers. Adjust it until the sound of 
the talker's voice is at the level you desire, which should he as low as possible 
to force yourself to Hpread. 
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The second way to adjust volume is by using the computer's internal volume 
control. 

( >n Windows computers this control is found by clicking the small icon of 
a yellow loudspeaker located in the task bar at the bottom of the screen. 
Clicking that icon brings up a slider with which jot can adjust audio volume. 
Put the cursor on the small rectangular button, click down on the left mouse 
button and drag the slider in the direction in which you wish to change the 
volume. Then release the mouse button. 

On Macintosh computers the interna) volume control is accessed by pulling 
down the Apple menu, then going to Control Panels and selecting Monitors 
& Sound* Click the Sound icon to bring up a window containing the 
Computer System Volume control. Adjust this slider as desired. A brief tone 
is sounded to give you a sample of the volume level you have adjusted. 

When you adjust your computer's volume control you will probably have to 
go back and forth to listen to the talker's voice and re-adjust the volume to 
get if where you want. 

What have I learned so far? 

You've learned quite a lot. You know how to select practice mode and have 
become familiar with the buttons for that presentation. 

You also know how to: 

Select an item to be played 

click the labeled button 

Repeat the previous utterance 

click Repeat 

See the word presented at a slow rate 

click Slowmotion 

Turn off the sound (or Visual Only presentation 

click the loudspeaker button 
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Turn oH the picture (or Auditory Only presentation 

click the video button 

Select Auditory-Visual presentation 

leave both the "face 11 and "ear 1 * buttons unclickcd 

Adjust the volume 

use cither the volume control on your loudspeakers or your computer's 
internal volume control 

Introduce background noise 

click Noise 

Select the type o( noise used 

click the adjacent circle 

Set the level of the background noise 

click the desired level 

The final thing you need to know is how to exit from the lesson screen. To 
do so, simply click the Finish burton in the bottom right-hand corner. You II 
see that you have returned to the Roundcd-IJp Vowels screen. From there 
you can choose any of the lessons in that subgroup, or you can back up* by 
clicking Back {or pressing Bsc), to go to the subgroup- or group-selection 
screens. 



Using Test Mode 

Now that youVe had a chance to use practice mode, you arc probably 
interested in seeing how test mode works. Assuming you arc still at the 
Lesson Selection screen for Rounded-Lip Vowels, click Roundcd-IJp Vowels 
1 and youll sec the introductory text screen again. 
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You Ye seen tin screen before, bur last nmc you selected Practice, "ITiis nmc, 
trv Test mode. 



M 
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Kounaed'Lip vowois 1 
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Click l est and rau'll mnvc to ihc Icssnn screen seen here. 



I n Rounded-Lip Vowels 1 




'I his screen l<x>k5 exactly the same xo the screen you saw for the practice 
mode except that the Noise burton and the audio and video on/off icons ar 
the bottom of the screen are faded nut, indicating that these controls cannot 
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be used. It is important ro remember that when a lesson is used in Test Mode 
these hems * the noise, and the auditory and visual presentation conditions 
* must be chosen prior ro entering the lesson. They canm u be changed after 
\x>u enter the lesson. If you want ro change them, click Pints!), and re- select 
the lesson, and then adjust them as desired on the lesson serup screen. 

Vou may have already noticed the other important difference between rest 
and practice modes. When you enrered the lesson you may have heard or seen 
the talker speaking one of the seven words tn this lesson before you clicked 
a button. That is because in test mode the program controls the presentation 
of the items and you respond, clicking the button that you think is associated 
with that item. If you think yi m know which item was spoken by the talker 
at the start of the lesson, click that burton. If you warn to have it presented 
again, click Repeat. Repeat it as many times as you like and have if presented 
in slew-motion if you like. But eventually you must give an answer by 
clicking the w ord that you think w as spoken. Seeing and Hearing Speech will 
then tell you whether that answer was correct or incorrect, 

WOte; There is a brief time after presentation of a speech item when the program 
does not respond to button clicks. Repeat your dick if the first one did not register. 

Correct? 

If your response was correct, this window will appear on the screen. 

Correct answer! 

♦ * ■ <. . ( n* * 



_ 



Vou can then click Next item to have another word presented tor identifica- 
tion. Alternatively, you can click Repeat to see the WTird attain. This is a 
useful thing to do if you were unsure about your response the first time. You 
can have the word presented a^ain just to check how r it looks and sounds. 
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There is a Finish hutton on the screen as well, but don't click it until you 
warn in finish the Icssnru 

Incorrect? 

If your response was incorrect you'll sec this window. 
Xhtt antw*r w>» Incorrect 

- I f y a o a J n 7 




Again, you are shown the answer you gave and arc offered two options in 
addition to Finish. If you want to see the word again, click Try again and the 
presentation will he repeated. If your response is still incorrect, don't worry. 
You can repeat this procedure as many times as you like. If you want to see 
the correct answer, however, click Solution and you'll see this window. 











Cwlil wfwvti **** 










1 — II — II - 1 



You now have three possihle options - four if you decide m >u'vc had enough 
and choose to Finish. 

New item 

click this hum m and you'll get a new wi ird to identify: 
View Corr. 

click this hutton to have the correct word presented again. 
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View Your 

click this button and the word you .selected (incorrectly) as your response will 
l>e presented. This wind* iw will then return to offer ynu the same i iptions. 

View Corr. anil View Your are useful options because they allow you to 
compare the correct utterance with the one you thought was spoken. Over 
nine this can help you pick up differences between words. \\ hen you make 
a mistake it's a good idea to take advantage of rhese options so thai you can 
compare and contrast the two alternatives. 

You should rake a little time to become familiar with these various options. 
If you are able to get all of the answer* correct, ynu might have to "cheat'* a 
little n i see the various options. If you have to, make a few "mistakes' 1 so ihat 
you can work with the Incorrect Response window. 

How do I finish? 

W hen vnu feel that you've done enough of a particular lesson, you can finish 
by clicking Finish. You'll find this button in the Correct, Incurred, and 
Solution windows, as well as on the main lesson screen. Alter you click Finish 
you'll sec a new window that giv es you a summary of your performance with 
this particular lesson. An example is given below. 

Score: 

MliMMtflHim [~* I 

LZD 



In this case nine words were prcscnied, live of them were identilied correctly 
and four incorrectly, "lite resulting score is therefore 56% correct. This score 
will be stored under the user name in effect at the time of the test. 

'[Tic score that is calculated is based on the first response for a particular item. 
You may ask for a repeat after your first response and then identify the word 
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correctly the second time, but this selection will not be used in calculating 
your score. For example, suppose the word presented is "bought* 1 and you 
click the word "boot/* You are then presented with the window informing 
\xhi that the response was incorrect. You choose "Try again" and this time 
identity' the word correctly. Because Seeing and Hearing Speech only counts 
the first response, the response to this item will be scored as incorrect. Note 
also, however, that you can ask for a repeat using the Repeat button on the 
lesson screen as many times as you like prior to responding. 

Once youVc seen your score you can then click OK and you'll be returned to 
the LcstOH Selection screen tor Rounded-lip Vowck 'Inhere you can choose 
a lesson from that set or go back up to choose other lessons. For example, if 
you decided that you wanted to switch to Consonants, you would click Rack 
repeatedly until you were at the contents screen. 

Over time you will become more and more familiar with the buttons that 
allow \ou to go forwards and backwards through the program. Don't worry 
if you make an error in navigation every now f and then; it happens to 
everyone. Relax and enjoy Seeing and Hearing Speech and let it help you 
develop better speech recognition skilk 

How do I exit Seeing and Hearing Speech? 

To exit the program, click Back repeatedly until you arc back at the Startup 
screen, and then click Rxit (or Quit on Macintosh computers). 
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Types of Lessons 

This Chapter has used one lesson from fhe Vowels group as an example, 
hut there are many other lesson types, both within the Vowels group and in 
the other groups. All of the lessons arc listed in Appendix A. *lTic lesson 
chosen as an example here is from the Vowels subgroup called Roundcd-I jp 
Vowels* *Ilic vowels in this subgroup all have similar lip shapes and so 
arc distinguished more by sound than by liprcading. The lessons within 
this group use words containing these vowels, with those words spoken in 
isolation, in short phrases, or in sentences. 

Most of the lessons in the Vowels and Consonants groups follow this 
pattern. They focus on a group of speech sounds with similar lip shapes 
with those sounds presented in words, phrases and sentences* Other lessons 
in these groups will present comparisons of the sounds with different lip 
shapes, again in words, phrases, and sentences* 

Lessons in the Stress, Intonation, and length group focus on different ways 
that words and syllables can be emphasized. They present comparisons of 
pitch inflection, stress (emphasis or accent), and length of utterances. 

The lessons in Kvcryday Communication arc organized around various 
common situations or related words. These arc lessons, for example, on 
numbers, addresses, and names, as well as common expressions used in 
restaurants and around the home. The next section presents guidelines for 
the use of these lessons. 
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Order of Lessons 

When a Task is complex, as auditory-visual speech reception is, it is usually 
best to break ir inco its component parts and build up an understanding 
of the larger task from a mastery of The components. It is recommended, 
therefore, that you start your Training with Vowels and Consonants. Practice 
with the word and phrase lessons before going on to sentences in each group. 
The Comparison lessons (e.g.* Vowel Comparisons A) should be attempted 
after you have learned the sounds that arc covered in that comparison. The 
lessons have been arranged in accordance with this approach so That you can 
simply proceed in the order in which they appear. 
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Using Test and Practice Modes 

Por a given lesson it is best to work through it first in practice mode, 'litis 
allows you to become familiar with the utterances and also to adjust the audio 
conditions (audio on/off, volume control, and background noise) so that 
the Auditory-Only task is neither too easy nor too difficult. After practicing 
you can go back up to the Ixsson Selection screen to do the same lesson 
in test mode. Try this using Auditor)' Only presentation at first and then 
Auditory- Visual. Comparison of your scores- under these nvo conditions 
allows you to gauge how much better you understand speech with lipreading 
than without it. 



When you conduct a lesson in test mode, be sure to continue it for a number 
of trials. In order to get a good sample of all the items in the lesson, and 
to ensure reliable results, it is best to rest for at least twenty trials. The more 
trials the better, but you should always try to have at least twenty trials in 
a tcst. 
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Adjusting Presentation Conditions 

Seeing and Hearing Speech is based on ihc idea that everyone has strengths 
and weaknesses in their ability to understand speech. Our aim is to have you 
build on those strengths and reduce those weaknesses. Quite often people 
differ in their ability to understand speech in the three possible presentation 
conditions * Auditor)' -Only, Visual-Only, and Auditory-Visual — and this 
program provides the opportunity to practice in all of these conditions. 

Some people are excellent liprcadcrs, while others have great difficulty under- 
standing even the simplest items presented via vision only. The reasons 
why some people excel at liprcading, while others struggle, arc not well 
understood. It is known, however, that the ability to lipread vowels is a good 
indication of an individual's overall Hpreading abilities- For this reason we 
recommend that everyone using the program spend time practicing with the 
vowel items in the Visual Only condition. 

People also vary greatly in their ability to understand speech through listening 
alone. Although an individual's auditor)' speech understanding skills are 
related to some extent to her/his degree and type of hearing loss, even 
people with identical hearing losses can vary greatly in their ability to under- 
stand speech via listening alone. You may find that some tasks arc relatively 
easy to complete via listening alone while others are extremely difficult. For 
example* many people will find the Stress, Intonation and Ixngth exercises 
relatively easy to complete in the Auditory Only condition, but experience 
great difficulty with many of the Consonant items. 'lake your time and 
work through each of the lessons in turn and sec how well you arc able to 
perform them. 

Finally, the ability to combine the auditory and visual signals can vary a great 
deal from person to person. But, even if a pcrson*s auditory-only ability is 
low, listening can still make a large contribution to auditory-visual speech 
understanding. Auditory-visual speech scores arc not simply the result of 
adding together a person's auditory-only and visual-only scores. For example, 
if a person scored 20% correct for a particular test presented via listening 
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alone, and 20% when the same material was presented via liprcading alone, 
he or she would almost certainly not score 40% correct when the test was rc- 
administcrcd auditory-visually, but rather 60 - 80% correct. The benefits of 
combining the two signals exceed merely adding the two scores together. 

Remember that the only way to discover your strengths and weaknesses 
is to experiment with the program. Once youVe found where you have 
problems you can practice with rhem in a particular presentation condition, 
or experiment wiih using the combined approach - listening plus looking - 
and see what effect this has on your performance. 

Suggestions 

Here arc some suggestions for using Seeing and Hearing Speech to enhance 
your communication skills. 

1 Choose a condition that makes speech understanding difficult, but not 
impossible. Don't put yourself in a situation where you have little or no 
chance of identifying the correct items. If the task is too hard, try a different 
presentation condition. Please don't sit there becoming more and more 
frustrated as you struggle to understand. On the other hand, if you find 
that a particular lesson is too easy, try to make it more difficult by adding 
some background noise. Not too much initially. It's better to raise the noise 
level little by little until you find a point where you experience challenge, 
but not failure. 



2 It's best to familiarize yourself with the lesson and its materials auditory- 
visually before you move on to a more difficult condition such as Auditory- 
Only or Auditory-Visual in noise. Don't rush this process Make sure you arc 
comfortable with the lesson before you proceed to more difficult conditions. 

3 We've provided color-coded guidelines at the start of each lesson which 
rank its difficulty in each presentation condition. These represent a general 
"rulc-of-thumb" and may not be accurate tor all users of Seeing and Hearing 
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Speech, bur please rake notice of rhem 10 avoid unnecessary frustration. 
We've chosen che colors of traffic signal* to describe the difficult} of each 
condition. The colors have been assigned the following meanings. 

0 Stop! (Red Light) 

This material is nor suitable for this presentation condition. If you do 
use it, expect considerable difficulty. 

0 Proceed with caution. (Yellow Light) 

The materials in this lesson can he attempted in tin- training condition, 
hut they may be diflicuh. 

0 Proceed. (Green Light) 

The materials in this lesson are suitable tor this presentation condition. 

Here's an example to consider. 
0 Visual Only (Red Light) 
0 Auditory Only (Yellow Light) 
0 Audltory-Vtsua) (Green Light) 

In this case \vc strongly suggest that you don't attempt this lesson with Visual 
Only presenianon and haxe some reservations about attempting if Auditory 
Only. Our recommendation is that* at least initially! you should attempt this 
lesson \iith Auditory- Visual presentation. 

If you see a stop signal for a particular prcsenranon condioon it means we 
have real misgivings about attempting this lesson in this way. For example, 
many of ihe consonant groups such as P-B-M have almost identical lip 
shapes and movements and are virtually impossible to tell apart vu bprcading 
alone. TUj does not just apply to beginning bp readers. liven the best 
bpreaders cannot reliably diffcrcnoate between words such as "pit", "bit", 
and "mitt", or "pay", "bay", and "may" when they arc presented in isolation. 
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Instead, in real life communication, they rely on the use of context and other 
language cues to identify the correct word. Here's an example. Is the missing 
word in each sentence "pay", "hay", or "may*? 

Did you remember to the bill? 

My birthday is on the 4th of . 

The boat sailed across the . 

'Ellis is a rather easy test, but it should highlight hew we can differentiate 
between words that are visuallv identical. 

4 If you've worked through a lesson Auditory* Visually and scored more 
than 80% correct you should consider introducing some background noise to 
make the lask more challenging 'Iliat's "more challenging" by the way, not 
"much harder " Try the task with a little noise and gradually increase its level 
if you arc still able to understand most of the items correctly. Above all, take 
your time and don't rush into a situation which will lead to failure. 

If you find the presence of background noise too disturbing there is another 
way of making the audio signal more difficult * turning down the volume. 
Although this will have the desired effect, it is not all that realistic In 
everyday life people with a hearing loss should try to avoid this situation as 
much as possible. If someone is speaking to you in a voice that is too quiet 
you need to do something about it. Ask them - politely of course — to speak 
a little louder, or move closer to them so that you can hear better. 

5 If you experience difficulty with any items in cither the Visual-Only or 
Auditory* Visual conditions, remember that you have the option of using the 
Repeat or Slowmotion buttons. These will allow you to sec the item again 

at either normal speed (Repeat) or in slow* motion (Slowmotion). W hen you 
press the Slowmotion button you will sec the video at a much slower rate, but 
you will not hear the speech. In the Auditory-Only condition you only have 
the option of the Repeat button, but this should be used any time you are 
unsure of your response or want to hear a particular item again. 



6 The approach adopted in Seeing and Hearing Speech provides you with 



CHAPTER 4 
Training Guidelines 

36 



both auditory and visual information, but you should also consider how 
speech feels when it is produced. In this case you become The speaker. When 
you see or hear an item, ir is a good idea ro say it quietly to yourself and 
attend to what happens as you speak it. Can you feel the lips move? Wliai 
about the tongue and jaw? W hat does happen when \rai speak!* You can 
also observe yourself in a mirror and compare your visible lip movements 
with those of ihc speaker on your computer screen. You might even want to 
mount a small mirror near your computer so that you can check on your own 
speech movements every now and then. You should be trying to develop an 
awareness of speech and every cue, no matter how small, is going to help. 

7 Tinally, try to make sure that Seeing and Hearing Speech is only a part 
of your overall communication training Remember that the aim in the long 
term is to have better speech understanding in real life, so seek out com- 
munication in a variety of situations and with a variety of speakers. Involve 
family members and friends in the process, Ixr them see the program and 
encourage them to also produce some of the items and sec how well you do 
when they arc the speakers. Above all, have fun, try to sec everything in as 
positive a light as you can, and see mistakes as challenges to be overcome, nor 
a& insurmountable obstacles. 
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Chapter 5: Viewing Results 

The results of bnOBI conducted in tesi mode ire stored and can be 
recalled for bier inspection. To new your results, go to the Startup screen 
and click Results, which brings up the Results screen, as shown here. 



Results 
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The Results Screen 

The top of the screen shows the user's name, and the result* listed are those 
obtained by that user. |lf you wish to see the results of a different user at this 
point you must go back to the Startup screen, type Ctrbp (hold down the Ctrl 
key and type "p") and enter a new user name. Then return to Results.) 



The central part of the Results screen is a list of the lessons that have been 
conducted in test mode. 'Hie lessons are sorted according to the presentation 
conditions that were in effect during testing. Thcsv conditions are selected 
and indicated hy the icons below the table. When you first enter the Results 
window, the Auditory-Visual condition is selected, and the results tor the 
lessons listed were obtained in that condition. You can list the results 
obtained under another condition hy clicking the circle next to it. If the 
condition is one that involves noise, the results are also sorted by the npe 
and level of muse used. 
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Also shown in the tabic arc columns labeled "S of rimes" and "% correct 
today* 1 . Seeing and Hearing Speech combines the results from repetitions of 
the same lesson under the same conditions on the same day. Therefore, if 
you repeat a lesson with the same conditions on the same day, you will most 
likely see the entry under tl % correct today" change after each duplicate run. 
However, the "tt of times" entry will not increase because all runs of the 
same condition on the same day arc combined into one. The "# of times" 
entry will increase only if a duplicate is run on a new day. 

There arc Jive buttons on the Results screen. You are already familiar with 
Help and Tips. Clicking Print will cause the Results screen currently displayed 
to be sent to your printer. The Back button takes you back ro the Startup 
screen. The Plot button will bring up a graphic display of the results obtained 
over rime on a selected lesson, under the selected conditions. Before you click 
Plot, however, yt>u must select a lesson from the list. *I*his is done by moving 
the cursor to one of the lessons in the list and clicking it. '[ his will highlight 
that lesson. Now if you click Plot it will bring up the plot screen. 

Two other commands that may be useful for some users allow saving and 
deleting results, I f you wish to save the results of the current user, type Ctrl-s 
(hold down the Ctrl key while ryping "5")- This will bring up a W indows 
Save dialog box with which you can specify the Hie name and location of 
the file into which the data will be saved. All of the results from the subject, 
under all presentation conditions, will be saved to this file. The file will be 
a tab-delimited text file suitable tor importation into common spreadsheet 
programs. 

If you wish to delete all of the results of the current user, type Ctrl-c (hold 
down the Ctrl key while typing "c"). You will be asked to confirm your 
decision to delete the results. If you click 'Ok" at this point all of the results 
from the current user will be deleted and cannot be recovered 
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The Plot Screen 



This example shows the results of three tests on different dates with 
Rounded-lap Vowels I. 1 he percentage of correct answer*, with the date of 
each test k shewn at the bottom. 



Wfa Rounded-Lip Vowels 1 
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A printed record of these results can be made by clicking Print, which will 
send the plot to your primer. This printed record will have on it the user 
name and the presentation conditions and noise type and level. It provides a 
record of progress over rime for thai lesson under those conditions. W hen 
you are di me plotting results, click Back to return to the Results screen. There 
\ou can either select another lesson for plotting, or return to the Startup 
screen. 
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n order to learn how to maximize Your use of visual and auditorv cues 
for understanding speech, it is useful fo appreciate some of the basic 
principles of facc-to-facc speech communication. 



Letters vs Sounds 

The answers to questions such as "What's a vowel? and "What's a conso- 
nant? 1 * are nor as straightforward as they might seem. When we are talking 
ahout our writing system we all know that there are live vowels — a, c, i, o» 
and u — while the remaining (21) letters arc consonants. Spoken language 
also lias vowels and consonants, hut they do not correspond exactly to the 
letters, 'iTicre arc* in fact* ahout fifteen vowels and twenty-four consonants 
in standard American English. In some cases the relation between letter and 
sound is simple. *lTic letter "v", for example, is pronounced in only one way, 
and there is no other letter or combination of letters other than "v" that 
is pronounced like a *V\ *iTie letter "f " also has a unique pronunciation, 
but the letter combinations "ph", as in "phone", and sometimes "gh*\ as 
in "enough" arc also pronounced as an "f". 'Ilicn there arc the letters 
- the written vowels, especially — that arc pronounced in more tlian one 
way As we know; vowels have long and short (and other) versions, as seen 
in the different pronunciations of the "a" in "fame", "fed", and "father". 
Combinations of vowels can be even worse. Consider the sentence "The 
rough, dough-faced plough boy was bothered by a cough 11 in which there are 
four different pronunciations of "ough". 
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'l*hc table on the following page lists words containing the 1 5 vowels sounds 
and the twenty-four consonant sounds of everyday American Knglish. *!Tic 
organization of the table will be described shortly. 
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Vowels 


Consonants 


Rounded 


n n II 




ball 


pai 


kate 


book 


hat 


gate 


DOOl 


111 1 T 

QUI 


... a 

sing 


bird 




\ III. 


boat 


r-v 


It. 

flam 


lx>uc 


fi- 
ll nc 




1x>ll 


vi nc 




Spread 


vv~n 




beet 


wear 




bli 


rate 




bed 






bake 


T-D-N-L-S-Z 




bite 


toe 






doc 




Relaxed 


no 




bad 


low 




bud 


so 






Z*»e 






TU 

i n 






nil' i 






tint 






CH-J-SH 






cheap 






jeep 






sheep 






mirage 
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Speech Sounds and Lip Shapes 

When wc speak wc make sounds by moving our lips, jaw, and tongue in 
various ways while also vibrating the vocal cords and stopping the flow of 
air at appropriate times. Generally, vowels are made with the mouth open to 
varying degrees, while consonants are made cither by completely or partially 
restricting the airflow with the lips or tongue. 

Some speech movements arc easily visible, some arc partially visible, ami 
some arc never visible. The shape of the lips and the extent of mouth 
opening are highly visible and arc the main features involved in liprcading 
Depending on the talkers speaking habits, tongue movements may or may 
not be visible, or may be visible for some speech sounds but not others. Vocal 
cord vibration, unfortunately, is never visible. 

The vowels and consonants in 'I able 1 are clustered according to their similar* 
ity in visible Up shapes. *I*hc consonants "f" and "v" serve as examples 
of how this clustering is done. The "f" and "v" sounds are both made by 
placing the lower lip in contact with the upper front teeth and expelling air. 
The difference between them is that the vocal cords vibrate for a "v" hut 
not for an w f*\ That difference can be heard but not seen, however, and 
the fact that the w f" and "v" sounds have identical lip shapes makes it impos- 
sible to differentiate between them by liprcading It is possible, however, to 
distinguish an "f " or a "v" from all other lip shapes. 

The key to using liprcading to help you understand speech is to be able to 
recognize the lip shapes associated with the different speech sounds. Putting 
this visible information together with the cues you receive from hearing 
allows you to identify the utterance better than you could with hearing alone. 

Many of the lessons in Seeing and Hearing Speech involve recognizing cither 
vowels or consonants *!Tic organization of the items in the lessons follows 
the visually-similar clusters of the table on page 42. All of the clusters arc 
represented in individual lesson groups, except for the Til cluster. *I*hat 
cluster, like the F-V cluster, has two members that are differentiated by (invis- 
ible) vocal cord vibration. Fortunately, however, there arc very few words in 
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English that differ solely in the presence or absence of vocal cord vibration 
with the TH sound (as "fine" and "vine" do for the FV cluster). Another 
speech sound that has been intentionally omitted is ihc sound of the "g" 
in "mirage", which shares its lip shape with the others in the CH-J-SH 
cluster. Aside from appearing in that word and a few others {c.£, the "z" 
in "azure 1 * and the V* in "measure" and "pleasure"), " i* a relatively rare 
speech sound* 

Following is a description of the visible lip formations for each of the 
clusters. It might help you learn these shapes if you look in a mirror while 
producing the speech sounds. 

Rounded. Rounded-lip vowels are made by puckering, or rounding, the 
lips. Examples of rounded-lip vowel* include "oo rt as in "boot" and "oy" as 
in "boys." Although the seven vowels within this group have the common 
feature of lip rounding, there arc small differences among them in the degree 
of lip rounding (compare the "oo" in "boot" with the "er" in "Bert* 1 } and 
ihc degrees of mouth opening and mouth movement (compare the "oo" in 
"book* 1 to the "ou" in "bout* 1 ). 

Spread. Spread-lip vowels arc produced by spreading the lips as in a slight 
smile. Examples of spread-lip vowels include "ec" as in "beet* 1 and "ai" 
as in bait. Although the vowels within this group tend to look similar on 
the lips, small differences among them may be noticed in the degree of lip 
spreading (compare the "ce" in "beet" to the "c" in "bet") and the degrees 
of mouth opening and mouth movement (compare the "ce" in "beet" with 
the "i" in "bite"). 

Relaxed. Rclaxcd-lip vowels arc made with the lips in a neutral formation, 
neither rounded nor spread. Examples of relaxed lip vowels include the "u" 
as in "cut" and the "o" as in "cot". Though the vowels within this group 
will look similar, small differences among them may be noticed in the degree 
of lip spreading (compare the "a" in "cat" to the "u" in "cut") and in the 
degrees of mouth opening and mouth movement (compare the "o" in "cot" 
to the "a" in "cat*}. 
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P-B-M. The consonants "p", "b", and "m" arc formed by bringing the lips 
together to form a fight seal, and then releasing the seal abruptly. 

F-V. The consonant* "*f " and "v" are formed by bringing the lower Hp into 
contact with the upper front teeth. 

W-R. These two consonants arc produced with rounded Hp shapes* 

T-D-N-L-S-Z. Hach of the consonants in this group is formed by placing the 
tongue just behind the upper front teeth. The Hps arc in a neutral position, 
with a slight mouth opening. 

TH, These two consonants arc formed by contacting the tongue to the upper 
teeth, often with visible protrusion of the tip of the tongue. 

CH-J-SH. These consonants arc formed by closing the jaw almost com- 
pletely and placing the tongue in contact with the area just behind the inner 
gum line of the upper front teeth. 'They also exhibit a lip protrusion. 

K-G-NG-Y-H. These consonants arc produced with a moderately open 
mouth and with tongue movements inside the mouth that arc usually difficult 
to sec 

Stress, Intonation, and Length 

There arc several important characteristics of speech beyond the actual 
vowels and consonants that convey information about the message. 'iTic 
pitch, or intonation, of the voice is one such characteristic. We make voice 
pitch rise towards the end of a question and fall towards the end of a 
statement. Two other such characteristics — intensity and duration — along 
with intonation* signal that a syllable or word is "accented" or "stressed". For 
example, the difference between the pronunciation of the word "rebel" as 
a noun (RR-hcl) and as a verb (rc-BIil.) is made by speaking the accented 
syllable with greater intensity, longer duration, and slightly higher pitch 
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Some of these cues, such as pitch and intensity, arc primarily auditory. The 
duration for which a visible Hp pattern is held, however, can often be clearly 
discerned. Talkers will also use facial gestures to varying degrees in expressing 
stress or asking a question. 

Another type of cue that can be useful in lipreading is the pattern of visible 
mouth openings. This pattern arises from the fact that speech exhibits a clear 
alternation between vowels and consonants (or clusters of consonants, such 
as the "str" in "string"). We usually think of this pattern in terms of syllables, 
which consist of a vowel sound and one or more neighboring consonants. 
Because vowels arc made with the mouth fairly open, and consonants with 
the mouth more closed, the vowel/consonant alternation results in a visible 
open/closed pattern of mouth openings that follow r s the syllables. Thus, it 
is possible to track the syllables, and even count them, by following mouth 
openings. 

It is sometimes possible to use the pattern of mouth openings to obtain a 
clue about a spoken utterance. For example, suppose you ask a young child 
which sport she likes more ~ baseball or basketball. By watching the number 
of times her mouth opens and counting the syllables - two or three - you 
might be able to understand her response without hearing it. 



Use off Context 

The word "context" here means an awareness of the situation in which you 
arc communicating that allows you to anticipate what someone might say to 
you. People don't often say things that are completely unexpected, 'lltcrc is 
usually some background or circumstance that leads us to expect the kinds 
of things that might be said. When a waiter first approaches you after you 
arc seated in a restaurant, for example, there arc only a few things that he 
will very likely say. 

It is, in fact, difficult to think of situations in which you have no expectations 
about what a person might say to you. This knowledge can help enormously 
in understanding w r hat the person says and easing communication. If you VI 
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like a demonstration of the importance of knowing whar might be said, try 
doing a lesson in test modi* with Visual Only presentation without knowledge 
of the response alternatives. (You will need a partner who would both 
cover the item buttons so you cannot sec them and enter your responses 
appropriately)* Not having any knowledge of what might be said usually 
makes speech reception much more difficult than it is when the possibilities 
are known. 



Practical Communication Tips 

I here arc a number of things that you should do that can help you make 
use of your Uprcading and auditory skills for maximum communication 
effectiveness. 



* Position jrairself so that you have a good view of the talker's face. 

* Make use of facial expressions. Raised eyebrows, smiles, eye gazes, and 
head and body movements all help to communicate a talker's message. 

* If you lose track of the conversation, ask for clarification quickly* It will 
only get worse if you don't. 

* If a person speaks too quickly, ask him or her to speak more slowly 
and clearly. 

* Do not try to hide the fact that you have difficulty hearing 
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Appendix A: List of Lessons 



Vowels 


Vowel Comparisons B 




1 Wowis 


nounaeo-Lip vowels 


£ I'M rases 


1 Words 




ft nt 

2 Phrases 




J Sentences 


vuvvci w vi i lyjcii ijvi ij u 


4 Words 


1 Iwo-Syllablc Words 


5 Phrases 


2 Phrases 


6 Sentences 


3 Sentences 


opreaO-Lip VOWeiS 




1 Words 




2 Phrases 




d Sentences 




4 Words 




5 Phrases 




6 Sentences 








1 Words 




ft W%1 

2 Phrases 




3 Sentences 




4 Words 




5 Phrases 




6 Sentences 




Vowel Comparisons A 




1 Words 




2 Phrases 




3 Sentences 
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Consonants 


T n M 1 C 1 




1 Words - Initial Consonant 


r-D-M 


2 Phrases- Initial Consonant 


1 Words - Initial Consonant 


3 Sentences- Initial Consonant 


2 Phrases- Initial Consonant 


4 Words - rinaJ Consonant 


3 Sentences - Initial Consonant 


o Phrases- rinal Consonant 


4 Words - Final Consonant 


b Sentences - rinal Consonant 


b Phrases- Imal Consonant 




6 Sentences - Final Consonant 


Ln-J-on 




1 Words * Initial Consonant 


i V 


d Phrases- ImtiaJ Consonant 


1 Words - Initial Consonant 


3 Sentences - Initial Consonant 


2 Phrases* Initial Consonant 




3 Sentences - Initial Consonant 




4 Words- Final Consonant 


1 Words - Initial Consonant 


b Phrases- nnal Consonant 


2 Phrases- Initial Consonant 


6 Sentences - Final Consonant 


3 Sentences - Initial Consonant 




4 Words - rinal Consonant 


W-n 


5 Phrases- Final G>nsonant 


1 Words - Initial Consonant 


b Sentences - rinal Consonant 


2 Phrases- Initial Consonant 




J Sentences - Initial Consonant 


WUIIoUllaiU V^Uj llJJar ibUl lb D 




1 Words 


Consonant Comparisons A 


2 Words 


1 Words 


3 Sentences 


2 Phrase 


4 Words 


3 Missing-Word Sentences 


o Words 


4 Answer to Question 


b Sentences 




Consonant Clusters 




1 Words 




2 Phrases 




3 Sentences 



Stress, Intonation, 
And Length 

Word Stress 

1 'iTireeAKbrd Sentences 

2 Four-Word Sentences 

3 Nine-Word Sentence 

Intonation 

1 Statements versus Questions: 
short sentences 

2 Statements versus Questions: long 
sentences 

Word Stress and Intonation 

1 Thrcc-Wori 

2 Four-Word Sentences 

Syllabic Stress 

1 Words 

2 Sentences 

3 Sentences 

Expansions 

1 Children 

2 Car 

3 Flowers 

4 Leaves 
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Everyday Communica- 
tion 

Numbers 

1 Phrases 

2 Answer to questions 

3 Area codes 

4 Zip codes 

5 Birthday's 

6 Individual Birthdays 

7 Prices 

Names 

1 Isolated first names 

2 First names in phrases 

3 First names in sentences 

4 Isolated first names 

5 First names in phrases 

6 Spelled first names 

7 Individual first names 

8 Isolated last names - A 

9 Isolated last names - B 

Places 

1 IIS. city names in phrases 

2 Individual cities 

3 Foreign city names in phrases 

4 Foreign city names in answer to 
questions 
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Sentences Topics 

1 Sentence Topics 1 

2 Sentence Topics 2 

3 Sentence Topics 3 

4 Sentence Topics 4 

Common Phrases 

1 Greetings 

2 Simple questions 

3 Weather 

4 Filling in a form 



Related Words 

1 Vegetable words 

2 Fruit words 

3 Restaurant words 

4 Restaurant words in sentences 

5 I louse words 

6 House words in sentences 
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Appendix B: Installation and 
Setup 

Software Installation 

The installation instructions arc different for Windows and Macintosh com- 
puters. 

For Windows Computers 

1 Insert the Seeing and Hearing Speech CD-ROM into your CD-ROM drive. 

2 Double-click on My Computer on the W indows desktop, and then double- 
click on the CD-ROM drive labeled "SHS CD/ 1 

3 Install the Seeing and Hearing Speech program Tiles onto your computer 
by first double-clicking the "Install Seeing and Hearing Speech" icon on the 
Seeing and Hearing Speech CD-R< )M. Then follow the installation instruc- 
tions. 



4 Install QuickTime 5.0-2 for Windows by first double-clicking the ' Install 
QuickTime" icon on the Seeing and Heanng Speech CD-R< >M. Then follow 
the QuickTime installation instructions. 

Note: You do not have to enter information into the 'Enter Registration* screen (or 
QuickTime to install or operate correctly. On the "Choose Installation Type'* screen 
ot the QuickTime instalfer choosing "Minimum" is ait that is necessary for Seeing 
and Hearing Speech to operate correctly 



5 Install DirectX 8.0a by double-clicking the 'install DirectX" icon on the 
Seeing and Hearing Speech CD-ROM. 

Note: The DirectX 8.0a installer may need to reboot Windows after installing. 
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To run Seeing and Hearing Speech after installation: 
Click on "Seeing and Hearing Speech* 1 in the Programs submenu of the 
W indows Starr menu. You can also run the program by double-clicking on 
the "Seeing and Hearing Speech** icon on your desktop 

Note: The CD-ROM dfsk must always be in the computer s disk drive in order to 
use Seeing and Hearing Speech. 

For Macintosh Computers 

\ Insert the Seeing and Hearing Speech CD-ROM into your CD-ROM drive. 

2 Double-click on chc "SHS CD" CD-R( >M icon on the desktop. 

3 Copy the folder labeled Seeing and Hearing Speech to your hard drive by 
dragging the folder from the CD-ROM to your hard drive. 

4 Install QuickTime 5.0.2 by double clicking the "Install QuickTime" icon 
located in the QuickTime folder on the CD-ROM. Follow the installation 
instructions. 

Note: You do not have to enter information into the 'Enter Regtstmtion" screen (or 
QuickTime to install or operate correctly. On the "Choose Installation Type" screen 
of the QuickTime installer choosing "Minimum" is ait that is necessary for Seeing 
and Hearing Speech to operate correctly 



To run Seeing and Hearing Speech after installation: 

Double-click on the "Seeing and Hearing Speech** icon in the folder copied 
to your hard drive. 

Note: The CD-ROM disk must be in the computers disk drive in order to use 
Seeing and Hearing Speech. 
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Audio Setup 

If you arc unsure if The audio system on your computer is working, you can 
check it in the following w ay. 

On Windows computers, pull up the Starr menu and select Settings and then 
Control Panel In Control Panel, double click the icon labeled Sounds. This 
will bring up a list of sounds that Windows uses to alert users to certain 
events. Select (click) one that has a yellow loudspeaker next to it. Then go 
down in this window to the box labeled Preview, and click the arrow to the 
right. You should hear a sound every time )mi click the arrow. 

On Macintosh computers, pull down the Apple menu, go to Control Panels, 
and then select Monitors & Sound. In the resulting window; click the Sound 
icon. If you change the Computer System Volume slider in the window that 
appears a brief tone will be presented. 

If you hear the test sounds that your computer presents, then Seeing And 
Hearing Speech will be able to present audio correctly. All that remains 
is to adjust the volume appropriately, which should be done on the basis 
of listening to the speech items. Sec Chapter 3 of this guide for further 
instructions on setting volume. 

If you do not hear a test sound there are several possible reasons. The most 
likely is either: 

1 - the loudspeakers arc not properly connected to the computer, 

2 - power to the loudspeakers is not turned on; or 

3 - the volume control on the loudspeakers is set too low: 

4 - the computer's internal volume control is cither too low or is muted. 
On both Windows and Macintosh computers, there is a check box in the 
volume control window that allows sound to be muted. Make sure that is 
not checked. 

If there is still no sound after you arc satisfied that the loudspeakers are 
connected and working and the internal volume control is not muted, then 
there may be a problem with the audio subsystem on your computer, 'litis 
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problem will have to be investigated by someone knowledgeable. Check with 
the store where your computer was purchased, or contact a computer repair 
technician. 

Video Setup 

There arc two video settings that arc important for proper display of the 
video recordings in Seeing and Hearing Speech. 

On W indows computers, these arc called the Colors and Screen Area settings 
They arc accessed by first pulling up the Start menu, selecting Settings and 
then Control Panel. In Control Panel, double click the icon labeled Display. 
In the resulting Display Properties window select the tab labeled Settings. 
You will sec controls towards the bottom of the Settings window for Colors 
and Screen Area. 

On Macintosh computers these same controls are called Color Depth and 
Resolution. They arc accessed by pulling down the Apple menu, going to 
Control Panels, and then selecting Monitors & Sound. Click on the Monitor 
icon to bring up the relevant controls. 

For proper execution of the program, the Colors (or Color Depth) selection 
should be set to 32-bit or 24-bit True Color (or millions of colors). If only 
High Color {or thousands of colors on the Mac) is available, the program 
will still run, but the video quality will not be as high as with 24-bit or 32 -bit 
color {or millions of colors). 

The control for Screen Area (or Resolution) is at the right. Seeing and 
Hearing Speech will work with any screen area setting that is 800 x 600 or 
greater. However, there arc pluses and minuses to your selection that you 
should know about. 

A Screen Area {or Resolution) setting of 800 x 600 pixels will display the 
program at it's largest size (it will till the screen). A large display is good 
if your eyes need it. When running the program at 800 x 600 pixels, on 
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Windows computers, you will sec neither the usual title bar at the top of 
the screen (with its minimize and maximize buttons) nor the task bar at the 
bottom of the screen. 

A Screen Area (or Resolution) of 1024 x 768 results in a display that is 28% 
smaller than the 800 x 6fl0 display, but for most people it will be visually 
satisfactory* With that Screen Area setting on Windows computers you will 
be able to sec and use the title bar and the task bar You will also he able 
to switch to other programs by clicking on them in the background because 
the program screen tor Seeing And Hearing Speech will not occupy the entire 
area on your monitor. 
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Appendix C: Troubleshooting 
and Technical Support 

Possible Problems and Their Remedies 

'[ his section presents possible solutions to problems that are sometimes 
encountered. 

Pari ol the Seeing And Hearing Speech window is cut OH. (Windows) 

You need to re-size the window in which Seeing and Hearing Speech is 
displayed. Point the cursor at the edge of the display window that is cut oft 
When the cursor changes to a double-sided arrow; click and drag the edge of 
the window to reveal the full display. 

I cannot close the program in the usual way. (Windows and Macintosh) 
You arc usually able to close a Windows program by clicking the *X* in the 
upper right corner of the frame or a Macintosh program by clicking the 
close box in the upper left corner. For technical reasons, it is not possible 
to exit Seeing and Hearing Speech in cither or those ways. Note* however* 
that on Windows computers the other two buttons in the upper right, which 
minimize and maximize (or re-size) the window, work as usual. 
On Macintosh computers, however, the usual zoom and collapse buttons in 
the upper right are not available. 

I get a "Could not lind the CD" error and cannot run the program, 

(Windows and Mac) 

'[ his error occurs if the CD-ROM disk is not in the drive. Insert the disk 
in the drive and try again, The disk must be in the drive whenever you use 
the program. 



There is no audio. (Window s and Mac) 

Check the list of possible reasons for no audio given in Appendix B and in 
the section entitled "Selecting Presentation Conditions' 1 in Chapter 3. 
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The audio is distorted. (Windows) 

If the audio sounds rough or raspy and you have a Windows computer, then 
ihere is a setting that can he adjusted to try to remove the problem. Bur first, 
exit from Seeing and Hearing Speech, 'lltcn, to get to the relevant setting 
from the Start menu, select Settings and then Control Panel In the Control 
Panel, double click on the icon labeled "QuickTime", which will bring up the 
QuickTime Settings window. In that window; click on Options... This brings 
up a small window in which you can adjust a setting called the fifo size. You 
will sec the current setting in the box. Change this number, by clicking on 
the number box and then editing* to make it twice the current setting Click 
OK, and then close the QuickTime Settings window* and the Control Panel. 
Go back and try Seeing and Hearing Speech again. I f this has not solved the 
problem, go through these steps again and double the lifo sue a second time. 
If this does not cure the audio distortion problem by the time the fifo size 
reaches 2(H), it will not be solved by this method. 

Technical Support 

If you need technical support, please visit the Seeing and Hearing Speech 
website at http:/ /www r . secingspecch.com and click on the "Support" link for 
help with known problems and for answers to Frequently Asked Questions 
(FAQ). If your problem is not addressed there, send a description of it by 
email to tcch-support@scns.com, or by mail to: 

SHS Technical Support 
Sensimetrics Corp. 
48 Grove St. 
Somemllc, MA 02144 
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Seeing and Hearing Speech exploit* the multimedia capabilities of personal computers, to allow 
yiwi in learn ami practice hpreading at home and at your ova pace. Thu new interactive CD ROM 
Iron i Scmimctrics Corporation contains carefully planned lessons that hclpynu combine what )uu sec 
with what you hear to understand (peech belter. Seeing and Hearing Speech use* the latest multimedia 
techniilii^y and computer -aided learning leciuiiuucs in provide extensive, convenient tipreading 
on PC tit Macintosh computers. 
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